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Abstract 

In many situations, Miniature Aerial Vehicles (MAVs) are limited to using only 
on-board sensors for navigation. This limits the data available to algorithms used for 
stabilization and localization, and current control methods are often insufficient to allow 
reliable hovering in place or trajectory following. In this research, wc explore using 
machine learning to predict the drift (flight path errors) of an MAV while executing a 
desired flight path. This predicted drift will allow the MAV to adjust it's flightpath to 
maintain a desired course. 



1 Introduction 

Past automation work with miniature aerial vehicles (MAVs) at Cornell has produced in- 
teresting results [U and presented additional challenges. During past projects, results have 
often been limited not by insufficiencies in planning algorithms, but by navigation errors 
stemming from inadequate control in the face of realistic, breezy operating environments. 
In many cases the MAVs will simply drift off the desired path (Figure[T]). Thus, this project 
focuses on refining the basic motion of the same platform, and in particular, minimizing its 
drift. 

Our work focuses on reduction of low frequency drift in gps-denied environments. Similar 
work has been done, some using neural networks [3] or using adaptive-fuzzy control methods 
[5] to stabilize a quadrotor. Though this research has produced promising results, these 
methods were demonstrated only in simulation, not via live testing. 



Figure 1: Desired path vs. actual path due to drift. 



2 Platform 

We are using the Parrot AR. Drone quadrotor (Figure [2]), 
a toy recently available to the general public. Commands 
and images are exchanged via a WiFi ad-hoc connection 
between a host machine and the AR. Drone. All of our 
coding and control is processed on the host machine and 
sent to the drone. 

The AR. Drone has a multitude of sensors (accelerom- 
eters, gyroscopes, sonar, and more) built in, which utilize pjg^^g 2: Our Parrot AR.Drone 
for our learning purposes. Platform 

3 Approach 

Given the large number of sensors and navigation data available on our quadrotor platform, 
we suspected that there are unexploited correlations between these sensor values and the 
drift of the quadrotor. It is difficult for a human to recognize any solid correlation by 
looking at the data directly, but by using supervised learning methods we have been able 
to discover relationships between sensor values and quadrotor behavior, and use these to 
predict a large portion of the drift. 

To do this we recorded the onboard sensor data while simultaneously collecting ground 
truth locations over time. We collected the ground truth values using the tracking system 
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described in Section 3J_ After applying the post-processing described in Section 3^ to the 
collected data, we used supervised learning methods to learn to predict the drone's drift. 



For our supervised learning, we tested two support vector machine (SVMs) libraries 
that support regression. The first algorithm we tested was the LibSVM algorithm [3] in the 
Shogun machine learning toolbox [2j. The second algorithm we tested is the SVM-Light 
regression algorithm ^ and obtained similar results. Our system only records and trains 
on drift in the horizontal plane. We trained each axis (defined as X and Y) separately, 
resulting in two separate trained systems. 



3.1 Tracking System 

To collect ground truth data, we created a custom tracking system to track MAVs in the 
horizontal plane. This system uses an infrared LED on the drone, and a Nintendo Wii 
remote (connected to the computer though bluetooth) to track the MAV. During data 
collection, we record time, position from the Wii (in pixels), and 60 dimensions of data for 
prediction. This data comes from onboard sensors as well as the navigation computer of 
the MAV. 

To test our tracking system and to assist with data collection, we constructed a simple 
PD controller to center the drone in real-time. This system works well, and is demonstrated 
here: http : //youtu . be/pt J6E7 j W2LY( 




Figure 3: The tracking system developed to collect data for our project (Section 3.1) 
Left: The tracking hardware Right: MAV being tracked. 



3 



3.2 Training Data 



The training data we collected is divisible into three types: time, external data available 
from the tracking system, and onboard data available from the quadrotor. For training, we 
learn a mapping from the onboard data to the derivatives — pixels per second in each of x 
and y — computed using the time and the external data from the wii. During the testing 
or prediction phase, we predict the derivatives from the onborad data. 

The fields of data we collected, including all 60 dimensions of onboard data, are shown 
below: 



Data fields 


collected and used for trainine; and prediction 


Time : 


time 


Wii tracking system 


: wii_x, wii_y, wii_xd, wii_yd, wii_age, 




wii.staleness 


Onboard data: 


altitude roll pitch yaw vx vy vz acc_x 




acc_y acc_z controlState vbat vphi.trim 




vtheta_trim vstate vmisc vdelta_phi 




vdelta_theta vdelta.psi vbat.raw ref_theta 




ref_phi ref_theta_I ref_phi_I ref_pitch 




ref_roll ref.yaw ref.psi rc_ref_pitch 




rc_ref_roll rc_ref_yaw rc_ref_gaz rc_ref_ag 




euler_theta euler.phi pwm_motorl pwm_motor2 




pwm_motor3 pwm_motor4 pwm_sat_motorl 




pwm_sat jnotor2 pwm_sat JiotorS 




pwm_sat_motor4 pwm_u_pitch pwm_u_roll 




pwm_u_yaw pwm_yaw_u_I pwm_u_pitch_planif 




pwm_u_roll_planif pwm_u_yaw_planif 




pwm_current Jiotorl pwm_current Jiotor2 




pwm_current_motor3 pwm_current_motor4 




gyros_of f setx gyros_of f sety gyros_of f setz 




trim_angular_rates trim.theta trim_phi 



Over the course of this project, the following data points were collected: 11,934 hovering, 
1,640 with a directional command, and 417 with gusts of wind, for a total of 13,991 data 
points. Plots of a few fields of data over five capture sessions is given in Figure [4j 

Once the data is collected and logged to a file, we run post-processing to make it more 
suitable for digestion by the learning algorithms. First, we remove all duplicate entries and 
stale entries caused by network delays, then we compute the position derivatives (velocities) 
in pixels per second for both the X and Y directions, and it is this data that we learn on. 
Figure [5] shows the singular values of the data before and after normalization, to give an 
idea how many dimensions of information are present in the data. 



4 



X 10 



i^ime 



wiiy wiixd 
500 2000 
400 p^)\ 1 000 

300 

200 „, , 

-1000 



wii_yd 




35 ' 
30 
25 ' 
20 



200 
100 

I 

100 W ' If 




50 00500850 




5aOO5EOB50 



5aoi)5ra50 

acc_x 




5a0C5S0B50 



5a005SQB50 



500030050 



5aOO5EO05O 



Figure 4: Some of the data collected from five manual runs. The first plot is time, the next 
six are external data from the Wii tracking system, and the rest represent a fraction of the 
60 dimensions of internal data from the quadrotor's sensors. Note that these graphs are 
not meant to be analyzed, but are presented merely as an example subset of the available 
features over time. 



4 Results 



By training on data collected in the lab, we were able to predict quadrotor drift quite 
accurately. Figure [6] shows the actual drift velocity versus the drift velocity predicted by 
our learned model. The predictions are not perfect, but they do match the actual drift 
quite well, certainly much better than the null hypothesis of no drift at all. 

While Figure [6] shows results while hovering and drifting in normal indoor conditions, 
in Figure [7| we show results obtained by creating an artificially windy environment. We 
created this environment by waving a large board back and forth, buffeting the quadrotor. 
A model was then trained on a combination of windy and non-windy data and tested on 
other windy runs. As one can see in the figure, the quadrotor drifts significantly in one 
direction, and the prediction follows quite well. 
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Figure 5: (left) Singular values of the 60 dimensional training data before normalization, 
(right) Singular values of the 60 dimensional training data after normalization. As one 
can see, the sensor data set is fairly rich, offering quite a few dimensions of non-covariant 
information. 



5 Future Work 



Although our algorithm was able to accurately predict drift, we are still working on getting 
the prediction code to be fast enough to control the quadrotor in live flight. The SVM 
regression code runs quickly, but we're currently facing difficulties with delays due to I/O 
as well as a suboptimal configuration. We integrated and tested a complete feedback loop, 
but delays caused it to be unstable. 



6 Conclusion 



We are making strong progress towards predicting and removing the quadrotor drift. The 
drift is predicted fairly accurately via a 60 dimensional sensor data vector from the quadro- 
tor, and we hope to soon demonstrate a controller enhanced by the predicted drift. 
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Figure 6: Results for normal indoor conditions. Top left: predicted versus actual x drift 
at each timestep in pixels per second. Top right: predicted versus actual y drift at each 
timestep in pixels per second. Bottom: actual position versus position inferred from inte- 
grating predictions over time. 
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Figure 7: Results for environment with artificial wind. This environment was created by 
waving a large board back and forth, blowing the quadrotor off to the side. The learned 
model was trained on a combination of windy and non- windy data and then tested on other 
windy runs. As one can see in the figure, the quadrotor drifts significantly in one direction, 
and the prediction follows quite well. Top left: predicted vs. actual x drift. Top right: 
predicted vs. actual y drift; Bottom: integrated position. 
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